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(57) ABSTRACT 

This invention is a method and system for real-time report- 
ing of team-member contributions to team achievement in a 
contest. The method segments the contest into plural aspects 
for reporting purposes. Each reporter reports one or more 
aspects of the contest. Plural reporters can report the same 
aspect of a contest. When there is a redundancy of reports for 
an aspect instance, a single report is selected to represent the 



instance reports for that particular aspect instance. The 
representative reports for all aspect instances are assembled 
to form a contest report. 

The invention uses a game metaphor to provide enhanced 
entertainment to the reporter. However, this method and 
system is not limited to entertainment purposes. It can also 
be used where other motivations are present for the reporter. 
Reporters view a team contest and, using a predetermined 
team-member performance measurement methodology, 
measure the contribution to team achievement made by one 
or more team-members during that contest. These measure- 
ments are submitted via a data entry device to the Reporting 
System where they are scored and reward values are 
assigned to the contest participants for their contribution to 
team achievement. Comparing the individual measurements 
to a standard, determines their compliance. A feedback 
mechanism notifies reporters of their measurement errors as 
an aid to improving their future accuracy. Reporters* vali- 
dated measurements are filtered, scored, assembled into a 
CONTEST report and made available to all participating 
reporters. Optionally, the results are presented to the contest 
participants to guide the formulation of future competitive 
strategy. Measurement accuracy and scope of completeness 
is evaluated to determine the reporter's skill level. As his 
expertise in implementing the value system expands, the 
reporter progresses through a series of game skill levels. 
Reporters who discover refinements to the value/reward 
system can recommend their adoption into the team-member 
performance measurement method being employed. Refine- 
ments can be incorporated in the team-member performance 
measurement method used by al reporters. 
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FIG. 1 REPORTER Learning Process 
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FIG. 2 Team-member Learning Process 
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FIG. 3 
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FIG. 4 Reporting System Components 
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FIG. 5 Representative ASPECT Report 
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FIG. 6 Reporting System/ PLAYER Interaction 
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FIG. 7 Reporting System Configuration 
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FIG. 8 
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FIG. 9 Reporter Administration Process 
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FIG, 10 Report Management Process Sequence 
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FIG, 11 Quality Feedback Process Sequence 
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FIG. 12 PLAYER managed Reward System 
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METHOD AND SYSTEM FOR REAL-TIME 
REPORTIING OF TEAM-MEMBER 
CONTRIBUTIONS TO TEAM ACHIEVEMENT 

BACKGROUND FIELD OF INVENTION 

[0001] This invention provides people who are interested 
observers of team competitions with a means for gathering 
and transmitting data to a central processor where it is 
processed to produce an analysis of team-member contribu- 
tions to team achievement. 

BACKGROUND DISCUSSION OF PRIOR ART 

[0002] As we enter the twenty- first century increasingly 
more of the problems that must be solved by humans are 
complex in nature. Their solutions require the cooperative 
effort of group members with different but complementary 
skills and experience who must interact quickly and effi- 
ciently to craft a solution. Groups of humans when func- 
tioning as intended are commonly characterized as teams. 
The literature defines a team as follows: "A team is a small 
number of people with complementary skills who are com- 
mitted to a common purpose, performance goals, and 
approach for which they hold themselves mutually account- 
able/' 1 

1 The Wisdom of Teams; creating the high-performance organization; Jon R. 
Katzenbach, Douglas K. Smith, Harvard Business School Press, 1993 Boston 
Mass. 

[0003] Although reliance by humans on group effort pre- 
dates recorded history, high performance team effort is a rare 
occurrence. This is because as the literature states, "Indi- 
viduality and self-preservation remain the rule, shared 
responsibility based on trusting others is the exception. A 
reluctance to take a risk and submit one's fate to the 
performance of a team, therefore, is almost inbred" 2 . In 
many cases plural teams compete for the same resources and 
goals in a competitive environment. To be successful in a 
competitive environment, a team must strive to operate at 
maximum efficiency. This requires that all members' actions 
add to team synergy. 

2 The Wisdom of Teams; creating the high-performance organization; Jon R. 
Katzenbach, Douglas K. Smith; Harvard Business School Press, 1993 Boston 
Mass. 

[0004] Given the natural reluctance to team orientation, 
only a supportive value/reward system can encourage team- 
oriented action. An old business adage comes into play, "you 
get what you inspect not what you expect". By this axiom a 
team member will be motivated to maximize his or her 
performance as measured, because the value/reward system 
is based on what is measured. 

[0005] An effective team value/reward system consists of 
three parts; a) a protocol for observing team activity, b) a 
method and system for measuring team -member perfor- 
mance, and c) a method and system for reporting team- 
member actions contributing to team achievement. An 
example of a compatible protocol and measuring system is 
the subject of pending U.S. patent application Sen No. 
09/571,874, filing May 13, 2000. The scope of the present 
invention is c) a method and system for reporting team- 
member actions contributing to team achievement. It gathers 
and transmits data to a central processor where it is pro- 
cessed to produce an analysis of team-member contributions 
to team achievement. 



[0006] The complex nature and the accelerated or pro- 
tracted pace of activity of many team competitions make it 
difficult for a single reporter to identify the critical few 
team-member actions and collaborations that are causal to 
winning the contest. For this reason it is difficult for the 
reporter to gain more than a superficial understanding of the 
causality for team achievement while observing the contest. 

[0007] The deficiencies of existing methods for investi- 
gating and reporting the causes for winning team contests 
are as follows: 

[0008] a) Provide no means to report the discovery of 
the discovery of team-member actions and collabo- 
rations that are causal to team achievement, 

[0009] b) Provide no means for teaching a method- 
ology for observing and reporting team-member 
collaborations that are causal to team achievement, 

[0010] c) Provide no means for team-members to 
report their own contributions to team achievement, 

[0011] d) Provide no means to report discovery of 
successful team-member actions and collaborations 
to contest participants during the remainder of an 
on-going contest, 

[0012] e) Provide no means for reporters to collabo- 
rate while observing the contest. 

SUMMARY 

[0013] This invention is a method and system for real-time 
reporting of team-member contributions to team achieve- 
ment in a contest. The method segments the contest into 
plural aspects for reporting purposes. Each reporter reports 
one or more aspects of the contest. Plural reporters can 
report the same aspect of a contest. When there is redun- 
dancy of ASPECT report instances, a single report is 
selected to represent the plural reports for that particular 
aspect instance. The representative reports for all aspects are 
assembled to create a contest report. 

[0014] The invention uses a game metaphor to provide 
enhanced entertainment to the reporter. However, this 
method and system is not limited to entertainment purposes. 
It can also be used where other motivations are present for 
the reporter. Reporters view a team contest and, using a 
predetermined team -member performance measurement 
methodology, measure the contribution to team achievement 
made by one or more team-members during that contest. 
These measurements are scored and reward values are 
assigned to the contest participants for their contribution to 
team achievement. Comparing the individual measurements 
to a standard, determines their compliance with reporting 
rules. A feedback mechanism, shown in FIG. 1, notifies 
reporters of their measurement errors as an aid to improving 
their future accuracy. Reporters' validated measurements are 
filtered, scored, aggregated into contest reports and made 
available to all participating reporters. Optionally, the results 
are presented to the contest participants to guide the formu- 
lation of future competitive strategy as shown in FIG. 2. 
Measurement accuracy and scope of completeness is evalu- 
ated to determine the reporter's skill level. As his expertise 
in implementing the value system expands, the reporter 
progresses through a series of game skill levels. Reporters 
who discover refinements to the value/reward system can 
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recommend their adoption into the team-member perfor- 
mance measurement method being employed, 

[0015] The present invention achieves the following 
desired features: 

[0016] a) means to report team-member actions and 
collaborations that are causal to a team win; incor- 
porating a means for observing a contest in a manner 
that reveals the critical few team-member actions; 
and incorporating a means to value team-member 
actions for their contribution to a team win, 

[0017] b) means for teaching a methodology for 
observing and reporting judgements of team -mem- 
ber actions and collaborations. Reported measure- 
ments are compared to standard values and accuracy 
exceptions are fed back to the reporter with instruc- 
tions for proper measurement, 

[0018] c) means for team-members participating in 
the contest being reported, to perform the reporting 
task, 

[0019] d) means to report discovery of successful 
team-member actions and collaborations to contest 
participants during the remainder of an on-going 
contest, 

[0020] e) means for reporters to collaborate while 
reporting a contest. Reporters communicate through 
a standard Internet chat facility, sharing questions 
and opinions to enhance their reporting skills. 

[0021] These improvements are accomplished by the 
present invention, which provides the following abstract 
objects, which are shown in FIG. 3: 

[0022] 1. Process flow abstraction called COMPETI- 
TIVE ENVIRONMENT that represents a domain 
with a set of rules and conditions that determines 
which team -member actions are contested and which 
are uncontested. It also determines the relative val- 
ues of functionally different team-member actions, 
thereby influencing the activity which team -mem- 
bers employ while contesting to achieve a team goal. 

[0023] 2. process flow abstraction called CONTEST 
that represents a discrete event where two or more 
teams strive to exclusively achieve a common goal 
within a predetermined amount of time. 

[0024] 3. Process flow abstraction called POSSES- 
SION that represents a unique pursuit of a team goal 
within a CONTEST, beginning with the successful 
acquisition of the resources required to achieve that 
goal, and proceeding with the enhancement of those 
resources by stages until the team goal is achieved, 
the resources are lost, or the CONTEST duration is 
exceeded. 

[0025] 4. Process flow abstraction called ASPECT 
that represents a category of valued team-member 
actions that contribute to team achievement during a 
CONTEST. A team-member action within an 
ASPECT is called an ASPECT instance. 

[0026] 5. Process flow abstraction called PLAYER 
that represents a team member who participates in a 



CONTEST by performing actions and interacting 
with other team members in pursuit of a team goal. 

[0027] 6. Process flow abstraction called 
REPORTER that represents an interested CONTEST 
observer engaged in identifying, gathering and sub- 
mitting data measurements concerning team-mem- 
ber actions and collaborations that contribute to team 
achievement. 

[0028] 7. Process flow abstraction called ERROR 
CORRECTION CODE that represents a calculated 
quantity derived from an ASPECT instance measure- 
ment submitted to the reporting process by a 
REPORTER; and used to determine conformance of 
that REPORTER'S measurements, to a standard 
measurement value for an ASPECT instance, 

[0029] 8. Process flow abstraction called SKILL 
LEVEL that represents the level of competence 
attained by a REPORTER. To attain a specific 
SKILL LEVEL, the REPORTER must achieve a 
prescribed standard of performance as determined by 
the ERROR CORRECTION CODE values of his 
submitted ASPECT measurements as well as com- 
pleteness and timeliness of his reports. 

[0030] In addition, the present invention provides the 
following mechanisms also shown in FIG. 4: 

[0031] 1. The Registration Mechanism 100 is com- 
prised of a method and collection of co-operating 
software programs executing on one computer or 
plural computers on a network, that enables prospec- 
tive REPORTERS to become authorized to use this 
system. 

[0032] 2. The Login Mechanism 200 is comprised of 
a method and collection of co-operating software 
programs executing on one computer or plural com- 
puters on a network, that checks a REPORTER'S 
authorization to use this system when he submits his 
userlD and password. 

[0033] 3. The Sign-up Mechanism 300 is comprised 
of a method and collection of co-operating software 
programs executing on one computer or plural com- 
puters on a network, that enables a REPORTER to 
choose a CONTEST and ASPECT to report. 

[0034] 4. Capture Mechanism 400 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that receives compacted data 
reports submitted by REPORTERS and makes them 
persistent in a centralized database, 

[0035] 5. Parser Mechanism 500 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that parses each of these data report 
strings into ASPECT data elements, inserts the data 
elements into fields in a report object and stores the 
report object in the database. 

[0036] 6. Filter Mechanism 600 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that selects an ASPECT instance 
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report that is representative of all submissions for a 
given ASPECT instance. This filtering process elimi- 
nates the need to score all but one of the reports for 
each ASPECT instance within a CONTEST. 

[0037] 7. Assembly Mechanism 700 is comprised of 
a method and collection of co-operating software 
programs executing on one computer or plural com- 
puters on a network, that aggregates representative 
ASPECT reports to form POSSESSION reports. 

[0038] 8. Scoring Mechanism 800 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that scores all POSSESSION 
reports by distributing the value assigned to the team 
achievement, among the PLAYERs reported as con- 
tributors to the successful POSSESSION. 

[0039] 9. Publishing Mechanism 900 is comprised of 
a method and collection of co-operating software 
programs executing on one computer or plural com- 
puters on a network, that aggregates results showing 
team-members* contributions to team achievement 
for a CONTEST and publishes the results. 

[0040] 10. QC Mechanism 1000 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that compares all ASPECT instance 
reports to their representative report to see if data 
element values are identical to those of the repre- 
sentative ASPECT report. This mechanism classifies 
reports with identical values as "expected" and non- 
identical values as "unexpected". The identical and 
non-identical totals are compiled for each 
REPORTER that has signed-up to score a CON- 
TEST. A high occurrence of "expected" status indi- 
cates a high degree of reporting conformance of his 
ASPECT reports to those from most other REPORT- 
ERS. 

[0041] 11. Email Mechanism 1100 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that formulates and sends an email 
message to each REPORTER who has submitted 
reports. The email message is used to teach the 
REPORTER by pointing out his errors and directing 
him to study the ASPECT Reporting Rules that he 
has miss-applied. 

[0042] 12. Chat Mechanism 1200 is comprised of a 
method and collection of co-operating software pro- 
grams executing on one computer or plural comput- 
ers on a network, that enables the community of 
REPORTERS to interact and share questions and 
opinions while observing the CONTEST. When a 
REPORTER signs up to report a CONTEST, the 
Sign-up Mechanism passes his reporterlD to the 
Chat Mechanism and the REPORTER becomes 
authorized to enter the Chat Room for that CON- 
TEST. This enables the REPORTER to collaborate 
with other REPORTERS covering that CONTEST 

[0043] Those and other improvements are set forth in the 
following detailed description. For a better understanding of 



the present invention with advantages and features, refer to 
the description and to the drawings. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0044] Basic Structure of a Preferred Embodiment of the 
Invention 

[0045] The preferred embodiment of the present invention 
utilizes a pre-determined model for achieving a group goal 
that provides a common protocol for observing a CONTEST 
and a common value system to identify valued team-mem- 
ber actions. An exemplary model is defined in pending U.S. 
patent application Ser. No, 09/571,874, filing date May, 13, 
2000. However, other models for achieving a group goal 
could be employed. 

[0046] The present invention segments the CONTEST 
into discrete ASPECTS in order to reduce the complexity of 
the reporting task. The invention also permits redundancy of 
reports for each ASPECT instance. This has three beneficial 
effects, 1) redundancy tends to create a statistical frequency 
distribution for ASPECT report measurement values, with 
the highest frequency of occurrence being choosen as the 
"expected" value as shown in FIG. 5, 2) redundancy enables 
the selection of a representative report from the set of 
redundant ASPECT reports, thus reducing the threat to data 
integrity resulting from false reports submitted by a hostile 
reporter as shown in FIG. 5, 3) redundancy eliminates the 
need to score all but one report for each ASPECT instance. 

[0047] The present invention also incorporates a multi- 
user game metaphor to enhance its entertainment value. This 
game metaphor incorporates the re-occurring themes of 
teamwork and self-improvement. The theme of teamwork 
emerges as a) the team-work of PLAYERs is measured, and 
in the process REPORTERS learn how to identify and value 
teamwork b) PLAYERs use the reported results to improve 
their teamwork, c) REPORTERS cooperate to achieve com- 
plete ASPECT coverage of a CONTEST, d) REPORTERS 
collaborate with each other to learn effective reporting 
techniques and to participate in refining the ASPECT 
Reporting Rules. As the REPORTER'S expertise in imple- 
menting the value system improves, he advances through a 
series of game SKILL LEVELs. SKILL LEVELs are 
attained by achieving a high level of measurement accuracy. 
Since accuracy is a subjective interpretation of the reporting 
rules, the assumption is made that plural informed REPORT- 
ERS will tend to make similar subjective judgements. 
Another assumption is that REPORTERS will become more 
informed and skilled with practice. Therefore report accu- 
racy is defined as conformance to the norm. The subset of 
Normal reports for an ASPECT instance have the most 
frequently occuring ERROR CORRECTION CODE value 
in the set of ASPECT instance reports under consideration 
(see FIG. 5). Achat facility is provided for REPORTERS to 
collaborate in their interpretation and refinement of the 
reporting rules that REPORTERS must follow. The system 
administrator can incorporate these improvements into the 
reporting rules. This collaborative process could enable the 
team of REPORTERS to evolve and refine the value/reward 
system being employed. 

[0048] The present invention also has the capability of 
indirectly integrating the REPORTER into the CONTEST 
being reported. This occurs in cases where reported results 
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are processed by the system and fed in real-time to the 
CONTEST PLAYERs who formulate their CONTEST strat- 
egy using this feedback. In this case, the invention extends 
the CONTEST boundary to include the REPORTER as an 
indirect CONTEST participant as shown in FIG. 6. 

[0049] This embodiment of the invention consists of a 
collection of co-operating computer programs executing on 
one computer or plural computers connected by a network, 
as shown in FIG. 7. This particular implementation of the 
invention utilizes an IBM HTTP Server, SendMail Mail 
Server, IBM Websphere Web Application Server and IBM 
DB2 database on plural computers connected to the Internet. 
The computer programs that implement workflow are imple- 
mented as Java objects in the form of Java Servlets, Java 
Beans, Enterprise Java Beans and Java Server Pages. The 
Java program interface to the Mail Server is the Java Mail 
API. Standard Internet, television and wireless communica- 
tion protocols are employed to implement data transmission. 
However, any general-purpose message passing mechanism, 
programming language and computer platform is sufficient 
to implement the features of the present invention. The 
output of the Data Entry Device is telecommunicated over 
the Internet through a Firewall to an Internet server. 

[0050] The Reporting System shown in FIG. 8, is com- 
prised of Java Servlets, Java Beans, Java Server Pages and 
Enterprise Java Beans residing on the Internet Application 
Server. Objects are made persistent using Container Man- 
aged Persistent Enterprise Java Beans on the Internet Appli- 
cation Server connected through a firewall to a Database 
Server. The system verifies that the submission came from 
an authorized REPORTER and then processes the report 
along with reports from other REPORTERS to create a 
composite report for the entire CONTEST and publishes this 
CONTEST report as a Java Server Page or an XML file. The 
system also collects data on the quality of reporting and 
provides feedback to each REPORTER regarding the quality 
of his reporting. The system merges personalized report 
quality information into an explanatory text template and 
creates and sends the resulting text message as an email 
message via the Internet Mail Server using the Java Mail 
API. 

[0051] This embodiment of the invention is implemented 
in a fashion that reduces system administration. Internal 
system functions such as report processing and reporter 
feedback are automated, while REPORTER input such as 
report submission, REPORTER registration, Login, Chat 
session and CONTEST sign-up are event driven processes 
initiated by a REPORTER. 

[0052] For the purposes of teaching this invention, the 
following description of a preferred embodiment uses the 
general concepts of messages and entities, instead of object- 
oriented terminology. The Reporting System of this embodi- 
ment as shown in FIG. 4, consists of three sub-systems: a) 
Reporter Administration, b) Report Management, and c) 
Quality Feedback. The following mechanisms comprise 
these systems. 

[0053] Reporter Administration System 

[0054] Registration Mechanism 100 

[0055] The Registration Mechanism enables prospective 
REPORTERS to become authorized to use this system. It 
registers each distinct REPORTER and assigns a unique 



reported D to him. It can provide a reporterlD for an existing 
REPORTER when given a userED and password. 

[0056] Login Mechanism 200 

[0057] Checks a REPORTER'S authorization to use this 
system when he submits his userlD and password. Interacts 
with the Registration Mechanism to ascertain a REPORT- 
ER'S SKILL LEVEL and uses it to determine and present an 
appropriate set of game options for the REPORTER. 

[0058] Sign-Up Mechanism 300 

[0059] Enables a REPORTER to choose a CONTEST and 
ASPECT to report. The REPORTER is presented with a 
matrix containing ASPECTS and levels of committed 
REPORTER Coverage for the CONTEST he is signing up to 
report. This information enables plural REPORTERS to 
cooperate in providing evenly distributed coverage of 
ASPECTS within CONTESTS. Upon selecting a CONTEST 
and ASPECT, this mechanism presents the REPORTER 
with a form to record the ASPECT instance data for his 
chosen ASPECT. 

[0060] Report Management System 
[0061] Capture Mechanism 400 

[0062] Receives compacted data reports submitted by 
REPORTERS, adds a system time stamp and makes the 
record persistent in a centralized database. It then notifies the 
REPORTERS data entry device that his report has been 
received. This process is given the highest priority in order 
to free the REPORTER'S data input device for further use. 
This mechanism includes a Java Servlet operating on a high 
priority thread. The ASPECT measurement data is concat- 
enated into a stream by the browser for transmission to this 
Capture Mechanism. The efficiency of data transmission is 
aided by limiting the size of the data stream. The individual 
data parameters of the report can be identified by their 
character position in the stream. In addition to the measure- 
ment data elements, each report contains data elements to 
identify REPORTER, SKILL LEVEL, CONTEST, Team, 
ASPECT, POSSESSION and Error Correction Code. 

[0063] Parser Mechanism 500 

[0064] Processes the report data using a Java Servlet 
operating on a lower priority thread when system resources 
become available. This mechanism parses each ASPECT 
report data stream into data elements and populates a report 
object. It then makes the parsed report persistent in the 
centralized database. The Parser Mechanism maintains a 
reference to the last data stream that was parsed. This serves 
as a marker to identify new reports the must be parsed. This 
mechanism operates by periodically parsing data streams in 
queue, then sleeping in a timed sequence. 

[0065] Filter Mechanism 600 

[0066] A filtering process is employed to filter redundant 
reports. The Filter Mechanism retrieves the set of all parsed 
reports for a given ASPECT instance of a POSSESSION 
within a CONTEST It applies an algorithm to each member 
of the set to determine if an aging requirement has been met. 
If the aging requirement has not been met, that member, and 
all other members of the set, are marked "hold" and no 
processing takes place on members of the set. The Filter 
Mechanism applies the age testing process to another set of 
parsed reports in the database that has not been marked 
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"hold". If the aging requirement has been met, the Filter 
Mechanism selects a representative report from the set. One 
selection method is to calculate the most frequent ERROR 
CORRECTION CODE value from each set of parsed 
reports. The ERROR CORRECTION CODE identifies all 
reports relating to a specific POSSESSION that contain 
identical measurement values. The ERROR CORRECTION 
CODE is the sum of all data measurements in the data 
measurement string. Reports are grouped by frequency of 
ERROR CORRECTION CODE value for each ASPECT 
instance within a CONTEST. The frequency of occurrence 
of the ERROR CORRECTION CODE value for all reports 
relating to each ASPECT instance is determined. A report 
with the highest frequency ERROR CORRECTION CODE 
value is selected as the representative report. For a hostile 
attack false value to be chosen, it must have the highest 
frequency of occurance and an associated high visability for 
detection. The chosen report is subjected to the scoring 
algorithm of the value system and used as the valid mea- 
surement for that ASPECT instance. The Filter Mechanism 
then stores this report in the centralized database and marks 
all other reports in the set as "filtered". 

[0067] Assembly Mechanism 700 

[0068] Aggregates representative ASPECT reports into 
POSSESSION reports for the CONTEST This is accom- 
plished by loading the ASPECT measurement elements from 
the representative reports into the associated POSSESSION 
objects and making them persistent in the centralized data- 
base. 

[0069] Scoring Mechanism 800 

[0070] Scores all POSSESSION reports by distributing 
the reward value assigned to the team achievement resulting 
from that POSSESSION according to the scoring algorithm 
of the value system of the COMPETITIVE ENVIRON- 
MENT. The reward value attributed to the successful POS- 
SESSION is divided among PLAYERs that were reported as 
contributors to the success of the POSSESSION. 

[0071] Quality Feedback System 

[0072] Publishing Mechanism 900 

[0073] Aggregates POSSSESSION results into CON- 
TEST results showing PLAYERs' contributions to team 
achievement for the CONTEST. These results are formatted 
and published for optional distribution via website, interac- 
tive TV, wireless device, electronic scoreboard, newspapers 
or other media of mass distribution. 

[0074] QC Mechanism 1000 

[0075] Compares all ASPECT data reports to their repre- 
sentative report to see if ERROR CORRECTION CODE 
values are identical to those of the representative report. If 
they are, the reports are given "expected" status; if not 
identical they are classified with "unexpected 1 * status. The 
results are compiled for each REPORTER as a measure of 
his reporting compliance. If the "expected" total is equal to, 
or greater than the threshold for the REPORTER SKILL 
LEVEL of that ASPECT, the REPORTER is classified as 
"Skilled" in that ASPECT. This classification is passed to the 
Registration Mechanism where it is recorded in the 
REPORTER'S record. 



[0076] Email Mechanism 1100 

[0077] Formulates an email message consisting of a tem- 
plate of explanatory text merged with personalized data 
obtained from the QC Mechanism that shows the recipient's 
"expected" and "unexpected" totals and SKILL LEVEL. 
This email message is sent to each REPORTER who has 
submitted reports. The goal is a high occurrence of 
"expected" status indicating that his results where similar to 
those from most other REPORTERS. 

[0078] Chat Mechanism 1200 

[0079] Utilizes standard Internet Chat technology to 
enable the community of REPORTERS to interact and share 
experiences and ideas without being physically co-located. 
When a REPORTER signs up to report a CONTEST, the 
Sign-up Mechanism passes his reporterlD to the Chat 
Mechanism and the reporter becomes authorized to enter the 
Chat Room for that CONTEST. This enables the 
REPORTER to collaborate with other REPORTERS cover- 
ing that CONTEST. It also enables messages to be sent to 
this group of REPORTERS by the system administrator. 

[0080] System Operation 

[0081] The Reporter Administration Process sequence is 
shown in FIG. 9. 

[0082] Step 1: 

[0083] A REPORTER registers himself with the Registra- 
tion Mechanism 100. This is accomplished by using a fixed 
wire or wireless interactive Internet access device such as 
Personal computer, interactive TV set-top box, personal 
digital assistant, wireless phone, or other similar device to 
make selections and transmit data to the system data pro- 
cessing computer. The REPORTER chooses a user name and 
password and is assigned a unique reporterlD and a game 
SKILL LEVEL-0. The inputs to Step 1 are username and 
password. The outputs of Step 1 are reporterlD and SKILL 
LEVEL. 

[0084] Step 2: 

[0085] A REPORTER togs into the Login Mechanism 200 
by submitting his user name and password. The Login 
Mechanism passes this information to the Registration 
Mechanism 100 and the REPORTER'S reporterlD is 
returned along with his SKILL LEVEL. The Login Mecha- 
nism uses this information to present the REPORTER with 
game options consistent with his SKILL LEVEL. The inputs 
to Step 2 are reporter user name and password. The output 
of Step 2 is a Java Server Page listing authorized reporting 
options for the REPORTER. 

[0086] Step 3: 

[0087] The REPORTER chooses a particular CONTEST 
from a list, and then chooses an ASPECT to report. A matrix 
showing the number of REPORTERS who have already 
made commitments to report on specific ASPECTS of his 
chosen CONTEST guides his choice. REPORTERS are 
motivated to choose the ASPECT with the lowest committed 
coverage in order to insure complete coverage of the CON- 
TEST. By adding ASPECT instance reports to the pool of 
CONTEST information submitted by all REPORTERS, a 
REPORTER qualifies to receive analyses derrived from the 
pool of information submitted by all REPORTERS. This 
gives the REPORTER expanded insight to causality for the 
team achievement that he would not have gained as a single 
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observer. Inputs to Step 3 are CONTEST, ASPECT and 
Team. Output for Step 3 is a Java Server Page data entry 
form for reporting the ASPECT specified in the input. 

[0088] Step 4: 

[0089] The REPORTER is presented with a data-entry 
form consistent with his SKILL LEVEL, and the CONTEST 
and ASPECT he selected during game sign-up. This form 
provides access to the specific ASPECT Measurement Rules 
that the REPORTER must follow in judging PLAYER 
actions. TTie form also provides access to the cumulative 
CONTEST information processed up to that point. The 
REPORTER submits the form with his ASPECT report 
measurements. This step is repeated for each ASPECT 
instance until the CONTEST ends. The input for Step 4 is 
ASPECT instance data. The output is an ASPECT instance 
report submission. 

[0090] Step 5: 

[0091] One representative ASPECT measurement is 
selected to represent each ASPECT instance of the CON- 
TEST for a team. Only those representative ASPECT mea- 
surements are processed through the scoring algorithm. An 
ERROR CORRECTION CODE is used as a measure to 
compare values of ASPECT measurements in the selection 
of the representative ASPECT report. One method for com- 
puting the representative ASPECT measurement is to group 
all ASPECT measurements by ERROR CORRECTION 
CODE value, for each ASPECT instance of a CONTEST. 
Then select an ASPECT report with the most frequently 
occurring ERROR CORRECTION CODE value as the 
representative measurement of this set. The Report Man- 
agement Process has 5 steps as shown in FIG. 10: 

[0092] a) On a periodic basis, the Parser Mechanism 
500 will check for the arrival of new ASPECT 
reports submitted by REPORTERS. It parses each of 
these report data strings into ASPECT data elements, 
inserts the data elements into fields in a report object 
and stores the report object in the database. This 
process is repeated until all reports in the arrival 
queue have been parsed. This process is repeated on 
a periodic basis. 

[0093] b) A filtering process is employed to reduce 
data processing and protect data integrity On a 
periodic basis, the Filtering Mechanism 600 will 
select a representative report for each ASPECT 
instance for a team in an ongoing CONTEST. 

[0094] c) The Assembly Mechanism 700 consoli- 
dates data from these representative reports to popu- 
late the POSSESSION report entity with ASPECT 
measurements and then stores the POSSESSION 
report in the database. 

[0095] d) The Scoring Mechanism 800 scores all 
POSSESSION reports by distributing the reward 
value assigned to the team achievement for that 
POSSESSION according to the scoring algorithm of 
the value system for the COMPETITIVE ENVI- 
RONMENT. The reward value attributed to the 
successful POSSESSION is divided among PLAY- 
ERs that were reported as contributors to the success 
of the POSSESSION. 



[0096] e) The Publishing Mechanism 900 aggregates 
POSSESSION reports to create CONTEST reports 
showing PLAYERs* contributions to team achieve- 
ment for the entire CONTEST. These results are 
formatted and published via website, interactive TV, 
wireless device, electronic scoreboard, newspapers 
or other media of mass distribution. The inputs to 
Step 5 are ASPECT instance reports. The output 
from Step 5 is a CONTEST report. 

[0097] Step 6: 

[0098] The Quality Feedback Process has 6 steps as shown 
below and in FIG. 11: 

[0099] a) On a periodic basis, with a lower process- 
ing priority, the QC Mechanism will check for CON- 
TEST reports that exceed an aging requirement. 
CONTEST reports that do exceed this age threshold 
are processed. 

[0100] b) CONTEST reports are parsed into their 
representative ASPECT instance reports. 

[0101] c) Each representative ASPECT instance 
report is used to retrieve all previously "filtered" 
reports for that ASPECT instance. 

[0102] d) Each of these "previously filtered ASPECT 
instance reports is compared with its representative 
ASPECT report using the ERROR CORRECTION 
CODE value to determine if data element values are 
identical to those of the representative report. If they 
are, the report is classified with "expected" status. If 
data element values are not identical, the ASPECT 
instance report is given "unexpected" status. The 
status results are a measure of reporting accuracy for 
each REPORTER that has signed-up to score the 
CONTEST, 

[0103] e) The sum of "expected" status ASPECT 
instance reports is compared to the REPORTER 
SKILL LEVEL threshold for that ASPECT, if the 
"expected" total is equal to or greater than the 
REPORTER SKILL LEVEL threshold for that 
ASPECT, the REPORTER is classified as "Skilled" 
in that ASPECT of reporting. 

[0104] t) The QC mechanism tells the Registration 
Mechanism to declare the REPORTER "skilled" in 
. that ASPECT of reporting. 

[0105] The inputs to Step 6 are ASPECT instance reports 
and CONTEST reports. The outputs from Step 6 are Total 
Expected, Total Unexpected, CONTEST, ASPECT and 
reporterlD, SKILL LEVEL. 

[0106] Step 7: 

[0107] The Email Mechanism formulates an email mes- 
sage consisting of a template of explanatory text merged 
with personalized status results obtained from the QC 
Mechanism that shows the recipient's "expected" and 
"unexpected" report totals and his SKILL LEVEL. This 
email message is sent to each REPORTER who has sub- 
mitted reports. The goal is a high occurrence of reports with 
"expected" status, indicating that the REPORTER'S mea- 
surements are similar to those of most other REPORTERS. 
The REPORTERS* status results are compared with the 
SKILL LEVEL threshold and his SKILL LEVEL is re- 
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evaluated. REPORTERS receiving an excessive number of 
"unexpected" results are instructed to study the ASPECT 
Measurement Rules to increase the quality of their future 
judgements and achieve or maintain SKILL LEVEL com- 
pliance. The Email Mechanism is also used to mass-com- 
municate messages of general interest to REPORTERS. The 
inputs to Step 7 are CONTEST, Expected Results, Unex- 
pected Results, reporterlD and SKILL LEVEL. The output 
of Step 7 is a personalized email message sent to each 
participating REPORTER showing his Expected Results, 
Unexpected Results and SKILL LEVEL. 

[0108] Step 8: 

[0109] When a REPORTER signed-up to report a CON- 
TEST in Step 3, the Sign-up Mechanism passed his repor- 
terlD to the Chat Mechanism and the REPORTER became 
authorized to enter the Chat Room for that CONTEST. As a 
result, the REPORTER can converse with other REPORT- 
ERS covering that CONTEST during and after the CON- 
TEST. The Chat facility enables the REPORTERS to learn, 
develop group consensus and formulate recommendations 
for improvements to the reporting rules for the COMPETI- 
TIVE ENVIRONMENT. The system administrator can 
incorporate these improvements into the reporting rules. 
This collaborative process enables the team of REPORTERS 
to evolve and refine the value/reward system being 
employed. The inputs to Step 8 are reporterlD and CON- 
TEST The output from Step 8 is a Chat Room for the 
CONTEST specified in the input, with the reporterlD autho- 
rized for access to the Chat Room. 

DESCRIPTION OF DRAWINGS 

[0110] FIG. 1 — shows Reporter Learning Process 

[0111] FIG. 2— shows Player Learning Process 

[0112] FIG. 3 — Containment Diagram showing Abstract 
objects 

[0113] FIG. 4 — shows Reporting System Components 

[0114] FIG. 5— shows the Representative ASPECT 
Report 

[0115] FIG. 6 — shows Reporting System Configuration 

[0116] FIG. 7 — shows Reporting System Application 
Server 

[0117] FIG. 8— shows Reporting System/PLAYER Inter- 
action 

[0118] FIG. 9 — shows Reporter Administration Process 
Sequence 

[0119] FIG. 10 — shows Report Management Process 
Sequence 

[0120] FIG. 11— shows Quality Feedback Process 
Sequence 

[0121] FIG. 12 — shows Team-member managed Reward 
System 

PREFERRED EMBODIMENT 

[0122] The present disclosure illustrates the invention as 
applied to the game and business of Basketball. It is pre- 
sented for the purpose of illustration and is not intended to 
limit the invention to the specific embodiment illustrated. 



[0123] The invention is intended to cover all implemen- 
tations within the scope of the appended claims. 

[0124] This embodiment is a method and system com- 
prised of a collection of cooperating computer programs on 
one or plural computers connected in a network. The 
REPORTER in this preferred embodiment is the dedicated 
fan of a Basketball team. The complex nature and the 
accelerated pace of activity during a Basketball game makes 
it difficult for a single fan, to identify the critical few 
PLAYER actions and collaborations that are causal to his 
team winning the game. While observing the game, it is 
difficult for fans to gain more than a superficial understand- 
ing of the causality for a team win. They find it easier to 
focus on PLAYERs* exceptional physical feats instead of 
creativity and collaboration among PLAYERs. Conse- 
quently, fans often focus on the superficial aspects of play. 
They are unable to attain their potential role, to provide 
emotional support to their team by recognizing and cheering 
excellence in all ASPECTs of team play. 

[0125] This preferred embodiment of the present inven- 
tion utilizes a protocol for observing the Basketball game 
that enables fans to focus on one or more of the critical few 
PLAYER actions that contribute to their team's achieve- 
ment. It also utilizes a value system demonstrated to be 
consistent with winning, for the fan to use in identifying 
effective PLAYER actions. The protocol and value system 
being used are described in pending U.S. patent application 
Ser. No. 09/571,874, filing date May 13, 2000. This meth- 
odology breaks the CONTEST into a set of elemental 
CONTESTS called POSSESSIONS. A POSSESSION repre- 
sents a unique pursuit of a team goal, beginning with the 
successful acquisition of the resources required to achieve 
that goal (ball), and proceeding with the enhancement of 
those resources (create shooting opportunity) by stages until 
the team goal is achieved (shooting to score points), the 
resources are lost, or the CONTEST duration is exceeded 
(game-clock time). 

[0126] This embodiment of the invention uses a game 
metaphor to enhance the entertainment value to the Basket- 
ball fan. The game is designed to have plural fans sharing the 
reporting effort, each reporting an ASPECT of the Basket- 
ball game. By reporting one ASPECT, each fan REPORTER 
gains access to the pool of data reported by all REPORTERS. 
REPORTERS compete with their own personal best report- 
ing accuracy to increase or maintain their SKILL LEVEL. 
However, they cooperate with fellow fan REPORTERS to 
insure that all ASPECIs of the Basketball game are reported. 
When fan REPORTERS analyze their conformance to the 
norm and discuss differences with the other REPORTERS 
via chat session, they can as a team evolve the reporting 
rules of the value/reward system being employed. This 
combination of self-competition and team-member collabo- 
ration mirrors the activity they are looking for in their roles 
as REPORTERS. 

[0127] Basketball Competitive Environment 

[0128] Winning a Basketball game requires the coopera- 
tion of five players. A Basketball game or CONTEST has a 
predetermined goal — to score more points than the compet- 
ing team in the prescribed amount of time. Equal access to 
resources (the Basketball) is mandated by rules that distrib- 
ute the ball evenly between teams but also allow teams to 
contest for possession of the ball. The game tempo and 
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changing team line-ups provide a constantly changing game 
environment. The Basketball COMPETITIVE ENVIRON- 
MENT provides a setting for pure competition. In the 
Basketball COMPETITIVE ENVIRONMENT there is a 
winning and loosing team at the action level, POSSESSION 
level and the CONTEST level. 

[0129] In the Basketball Competitive Environment, the 
ultimate goal — winning the game — requires a team to score 
more points than the opposing team. A team can only score 
points if it has possession of the Basketball. Since a game is 
the sum of its POSSESSIONS, acquiring and maintaining 
possession of the ball are the fundamental objectives of each 
POSSESSION. During a POSSESSION the goal of one 
team is to try to maintain control of the ball and score points 
while the goal of the competing team is to try to extend the 
duration of the POSSESSION until it is successful in 
acquiring control of the ball. Each POSSESSION has a 
winning team and a losing team based on whether or not 
points are scored during that POSSESSION. The sum of the 
results of all POSSESSIONS determines the result of the 
CONTEST, or game. Basketball rules give uncontested 
possession of the ball to a team after certain events such as 
an opponent's Field Goal. 

[0130] Operation 

[0131] Fans do not have to be present at the game to report 
the game activities. Watching on TV is sufficient to hear and 
see everything necessary to report most relevant ASPECTS 
of the game. According to the value/reward system being 
employed in this embodiment, relevant ASPECTS including 
acquiring control of the Basketball, creating a scoring oppor- 
tunity, shooting to score points and the game-clock time that 
PLAYERs enter and leave the game. Actions are only valued 
if they result in points being scored in a POSSESSION. A 
fan must identify a potentially valued action and continue to 
follow the play to see if the action is part of a successful 
sequence resulting in points scored. If points are scored, the 
potentially valued action becomes a valued action and the 
fan submits his ASPECT instance report for this POSSES- 
SION. Fans viewing the game on TV can submit their 
reports in one or more ways. These ways include via 
personal computer, interactive TV remote control, wireless 
phone or Internet access device. Their reports are transmit- 
ted to a centralized Internet server and become part of a pool 
of reports from which representative reports are selected to 
construct a composite report of all ASPECTS of the game. 
Fans only have to report on one ASPECT to gain access to 
the composite information compiled from all fan reports. 
Fans are allowed to chose the ASPECT they will report. 
They are encouraged to cooperate by selecting an ASPECT 
with a relatively low level of fan coverage, thus promoting 
adequate coverage of all relevant ASPECTS of the game and 
producing a complete CONTEST report. 

[0132] By cooperating as a community in this way, fan 
REPORTERS learn and reap the benefits of teamwork them- 
selves. Each fan REPORTER gains access to the pool of data 
gathered by all fans and processed by this system. This 
valuable information can also be used to benefit the game 
contestants. The game analysis produced from fan reports 
can be fed to the coaches and PLAYERS to guide competi- 
tive strategy as the game continues. A participant in the 
CONTEST can access the cumulative POSSESSION reports 
as they are processed and communicate the rewults ot the 



PLAYERs. As shown in FIG. 11, the fan will play an 
important part in determining the success of his team. This 
adds to the tun and entertainment value and increases the 
motivation for fans to participate. A by-product of this game 
is the learning experience. Fans are educated in the factors 
that produce a winning team effort. When they choose an 
ASPECT to report, they are presented with the ASPECT 
Measurement Rules for reporting PLAYER actions that have 
been demonstrated to produce winning results. By learning 
to recognize these PLAYER actions and collaborations, the 
fan learns the underlying factors that contribute to a winning 
team effort. This added insight creates a community of fans 
who find entertainment in collaborating via the invention's 
online Internet Chat Mechanism. 

[0133] The accuracy of the information produced by fan 
reporters is a key factor in the effectiveness of this embodi- 
ment of the present invention. The Quality Feedback System 
shown in FIG. 11, checks the level of compliance of a fan's 
reports and sends him an email report card after a game to 
explain how the ASPECT data in his reports compared to 
other REPORTERS* submissions covering the same 
ASPECT of that game. The email message shows the fan 
REPORTER how many of his POSSESSION reports had 
"expected" data values and how many had "unexpected" 
data values. It also contains a link to the ASPECT Measure- 
ment Rules, which he can study to help him achieve or 
maintain compliance on his future reports. As his expertise 
in implementing the value system expands, the fan 
REPORTER progresses through a series of game SKILL 
LEVELs. Fans are recognized as skilled in reporting a 
specific ASPECT when they achieve a prescribed total of 
"expected" ASPECT reports in a game. A fan REPORTER 
that achieves this SKILL LEVEL for a single ASPECT is 
motivated to gain skill in other ASPECTS until proficiency 
is attained in all ASPECTS of reporting. An example of 
ranking levels is Gold for proficiency in four ASPECTS, 
Silver for proficiency in three ASPECTS and Bronze for two 
ASPECTS. Special privileges can be awarded based on these 
rankings. 

[0134] When a fan signs up to report a game, he can be 
authorized to enter the Chat Room for that game. This 
enables the fan REPORTER to converse with other fans 
reporting that CONTEST. The Chat facility enables fans to 
learn, share their questions and opinions, develop consensus 
and formulate group recommendations. Fans who discover 
refinements to the value/reward system can recommend their 
adoption into the team-member performance measurement 
method being employed. 

SECOND PREFERRED EMBODIMENT 

[0135] Another preferred embodiment of this invention is 
a method and system comprised of a collection of cooper- 
ating computer programs executing on one or plural com- 
puters connected in a network for reporting actions by 
Selling-Team members that contribute directly to a Selling- 
Team sale in a commercial COMPETITIVE ENVIRON- 
MENT. The selling team is comprised of members who 
perform the same, or compatible but functionally different 
tasks in the sales process. The sales process typically con- 
sists of the following ASPECTs; acquiring contact informa- 
tion about potential customers, creating a solution person- 
alized to the customers* need,handling customer objections, 
testing to close and install the solution, and receiving 
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payment. Unlike the Basketball COMPETITIVE ENVI- 
RONMENT, in the COMMERCIAL COMPETITIVE 
ENVIRONMENT, competition is pure only at the testing, or 
Close and Install stage. Competing Selling Teams can pro- 
ceed successfully through the selling process to the testing, 
or Close and Install stage. In this scenario a sales opportu- 
nity is a POSSESSION. Only POSSESSIONS that result in 
payment for product or service are considered successful. 
The sales compensation for a sale is divided among the 
successful Selling-Team members according to the model 
developed for the commercial COMPETITIVE ENVIRON- 
MENT. 

[0136] The Selling Team can be self-managing. The pro- 
tracted time duration of the sales process allows the report- 
ing function to be performed by the member of the Selling 
Team who performed the valued action contributing to the 
sale. Initially, only his report will be processed for each 
ASPECT instance of a CONTEST. However, any member of 
the team could submit a challenging ASPECT report. In this 
case a different filtering process is employed to select the 
representative ASPECT report. A peer review process is 
used by team-members to choose the representative report 
from contending reports. This self-managing feature insures 
that the rules of the reward system govern with no personal 
bias. This feature would enable a scenario where operational 
supervision of the sales compensation system resides with 
the Selling-Team members themselves, as shown in FIG. 
12, thus eliminating an obstacle to making team operation a 
self-managing function. Self-managing the sales compensa- 
tion process also teaches the Selling-Team members effec- 
tive team behavior. 

[0137] In this scenario, a Managing Third Party pre- 
determines a protocol for observing the selling process that 
enables the REPORTER to focus on the critical few 
PLAYER actions that contribute to a sale. A Managing Third 
Party would also set the value system for the REPORTER to 
use in judging the effectiveness of PLAYERs' actions. The 
protocol and value system of this preferred embodiment are 
described in pending U.S. patent application Ser. No. 
09/571,874, filing date May 13, 2000. A Managing Third 
Party would also pre-determine the total sales compensation 
to be distributed among the Selling-Team PLAYERs. CON- 
TEST results would be published for analysis by Selling- 
Team members and the Managing Third Party. 

[0138] Conclusion: 

[0139] Exploiting the full potential of team synergy 
remains one of the most important opportunities of the 
twenty-first century. Doing so will improve team productiv- 
ity and provide enormous economic and social benefit for 
mankind. Existing methods and systems for reporting team- 
member contributions to team achievement do not identify 
the critical few team-member actions; they do not segment 
the reporting task into ASPECTs that can be comprehended 
in real-time by a single reporter; and they don't teach a 
methodology for observing and reporting team-member 
collaboration. There is a compelling need in all areas of 
human endeavor for an effective method for valuing, mea- 
suring and reporting a team-member's contribution to the 
achievement of a team goal. This invention is a method and 
system for gathering and transmitting data to a central 
processor where it is processed to produce an analysis of 
team-member contributions to team achievement. It uses a 



team-member interaction protocol for viewing the team in 
action and incorporating a value system to help the 
REPORTER focus on the critical few ASPECTs of the 
CONTEST. The measurement process is made easier by 
allowing each REPORTER to focus on one ASPECT for his 
REPORTS. In return, he benefits from receiving the consoli- 
dated CONTEST report derived from all relevant ASPECTs 
of the CONTEST. 

[0140] The use of a game metaphor adds entertainment 
value. It motivates the REPORTER to strive for judgement 
and measurement accuracy. The REPORTER receives feed- 
back of his measurement compliance, enabling him to 
improve bis insight and understanding of winning behavior. 
His expanding expertise is measured by a series of SKILL 
LEVELs. A connection between the REPORTER and the 
contest participants is created when the consolidated analy- 
sis is fed to the contest participants during an on-going 
CONTEST as input to the formulation of PLAYER strategy. 
The REPORTER indirectly becomes a participant in the 
CONTEST. This is the ultimate motivation for a 
REPORTER. 

What is claimed: 

1) A method for reporting the discovery of PLAYER 
activity that is causal to team achievement, comprising: 

a) means to segment reporting task into ASPECTs, 

b) means to record redundant ASPECT reports, 

c) means to select representative ASPECT report from 
redundant ASPECT reports, 

d) means to aggregate representative ASPECT reports to 
form a CONTEST report. 

2) A method of claim 1, including means to teach said 
method. 

3) A method of claim 1, wherein said reporting is accom- 
plished by PLAYERs participating in the CONTEST being 
reported. 

4) A method of claim 1, including means for CONTEST 
PLAYERs to access CONTEST analyses during the on- 
going CONTEST. 

5) A method in claim 1, including means for REPORTERS 
to collaborate. 

6) A system for reporting the discovery of PLAYER 
activity that is causal to team achievement, comprising: 

a) means to segment reporting task into ASPECTs, 

b) means to record redundant ASPECT reports, 

c) means to select representative ASPECT report from 
redundant ASPECT reports, 

d) means to aggregate representative ASPECT reports to 
form a CONTEST report. 

7) A system of claim 2, including means to teach method 
of claim 1, 

8) A system of claim 2, wherein said reporting is accom- 
plished by PLAYERs participating in the CONTEST being 
reported. 

9) A system of claim 2, including means for CONTEST 
PLAYERs to access CONTEST analyses during the on- 
going CONTEST. 

10) A system in claim 2, including means for REPORT- 
ERS to collaborate. 
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